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Abstract — In this paper, we propose a switching based median 
filter for the removal of impulse noise, namely, the salt and 
pepper noise in gray scale images. The filter is based on the 
concept of substitution of noisy pixels prior to estimation. It 
effectively suppresses the impulse noise in two stages. First, 
the noisy pixels are detected by using the signal dependent 
rank-ordered mean (SD-ROM) filter. In the second stage, the 
noisy pixels are first substituted by the first order 2D 
noncausal linear prediction technique and subsequently 
replaced by the median value. Extensive simulations are 
carried out to validate the proposed method. Experimental 
results show improvements both visually and quantitatively 
compared to other switching based median filters for the 
removal of salt-and-pepper noise at different densities. 

Index Terms — Impulse noise, Detection based median filter, 
Noncausal linear prediction 

I. Introduction 

Digital images are frequently corrupted by impulse noise 
during the process of image acquisition and/or transmission. 
Preserving the image details and attenuation of noise are the 
two important aspects of image processing which are always 
contradictory in nature. So the research emphasis is on the 
removal of impulse noise while keeping the loss of details to 
minimum. There are two types of impulse noises, namely, the 
salt-and-pepper noise and the random valued impulse noise. 

Linear filtering techniques do not perform well for the 
removal of impulse noise. On the other hand, nonlinear 
techniques have been found superior and provide more 
satisfactory results while preserving image details. The most 
basic nonlinear filter is the standard median (SM) filter [1]. 
The SM filter works effectively at low noise densities but at 
the cost of blurring the image. One way to improve this 
situation is to use the weighted median (WM) filter [2] which 
gives more weight to some values within the window than 
others. The special case of the WM filter is the center weighted 
median (CWM) [3] filter which gives more weight only to the 
center value of the window. The major drawback of these 
filters is that they do not detect a priori whether a pixel in the 
image is actually corrupted by impulse or not and simply 
replaces every pixel by the median value of the pixels in its 
fixed neighborhood. A better strategy to circumvent this 
drawback is to incorporate some decision-making processes 
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or switching in the filtering framework. 

The switching based median filter performs well for the 
removal of impulse noise in comparison to the CWM filter 
with better preservation of details. Some of the state-of-the- 
art switching based median filters are the rank-conditioned 
mean (RCM) [4], the signal-dependent rank ordered mean 
(SDROM)[5], the tri-state median (TSM) [6] filter, the adaptive 
center weighted median (ACWM) [7] filter, the directional 
weighted median (DWM) [8], the adaptive switching median 
(ASWM) [9], and the new switching based median (NSWM) 
[10] filters. In the SD-ROM filter, multiple thresholds are 
considered in detection of the corrupted pixels and then the 
detected pixels are replaced by the rank-ordered mean (ROM) 
value of the pixels in the current window. Another recently 
proposed switching based median filter with preservation of 
fine details on images corrupted by the salt and pepper noise 
is the new switching based median (NSWM) filter. This filter 
uses the concept of substitution of noisy pixels prior to 
estimation. It employs the causal ID linear prediction strategy 
for the substitution of all the noisy pixels within a window. 

The NSWM filter has been found to perform quite well 
for the removal of salt and pepper noise at high noise ratios 
[10]. However, it does not utilize the 2D structure of an image 
for the prediction of the noisy pixels and hence does not 
exploit the interline dependence of the pixels in an image. 
Therefore, the performance of the NSWM filter may be further 
improved by considering the natural structure of the pixels in 
an image. Moreover, it applies a very simple technique for 
the detection of the noisy pixels. In this filter any pixel having 
a value of either or 255 are considered as the noisy pixels. 
However, in practice this may not be always true. In fact, the 
uncorrupted image may also have some pixels of values of 
either or 255, so there is probability that some of the 
uncorrupted pixels in the image might also falsely get detected 
as the noisy pixels. 

In this paper, we propose a two stage switching based 
median filter for the removal of salt and pepper noise from 
gray scale images. In the first stage, the noisy pixels are 
detected by the detection stage of the SD-ROM filter. In the 
second stage, if a pixel is detected to be noisy then it is first 
substituted by using the 2D noncausal linear prediction from 
the neighboring pixels in a window centered at this pixel and 
subsequently the pixel is estimated from the predicted pixel 
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and its neighbors by computing the median. The uncorrupted 
pixels in the image are left unchanged. Finally, experiments 
are carried out to evaluate the proposed method both visually 
and quantitatively. The rest of the paper is organized as 
follows. In Section II, we review the impulse noise detection 
using the SD-ROM filter. Section III gives a brief overview of 
the 2D non causal linear prediction in gray scale images. The 
proposed switching median filter is discussed in Section IV. 
Section V gives the simulation results using different test 
images. Finally, conclusions are drawn in Section VI. 

II. Review of The Sd-Rom Filter 
Consider an 8-bit gray scale image X ■ Let Y(i, j) be the 
gray value of the noisy image Y at pixel (i, j) and 

W(i, j) be a window centered at (i, j) . We assume here the 
following impulse noise model: 

\X(i,j) , with probability l-y 
Y(i,j) = < 

[R(i,j) , with probability y 

where X (j, j) and R(i,j) denote the pixel values at 

location (z, j) in the original image and the noisy image, 
respectively and J is the noise ratio/density. In an 8-bit 

gray scale image, the salt and pepper noise R (i, j) can take 

either or 255. Since the proposed scheme uses the impulse 
detection stage of the SD-ROM filter, a brief review of this 
filter is given below. 

The SD-ROM filter consists of the following two stages 

[5]: 

A. Impulse noise detection: 

• Consider a 3 X 3 window W centered at Y (i, j) . Define 

an observation vector containing the pixels in the 
neighborhood of and obtained by a left-right, top-to-bottom 
scan of the window: 

W = [w 1 W 2 W 8 ] 

• Arrange the observation vector w by their ranks A given 

by A = [A p A 2 ,...,A 8 ] such that Aj<A 2 <..A g . 

• Define the rank-ordered mean (ROM) by 
M = (A 4 + A 5 ) / 2. Obtain the rank-ordered differences 



T , where 



Ai-Y(i,j\ if Y(i,j)<M 



(2) 



i Y(i, j) - A9 - 1, otherwise, 

for i=l,...,4. 

• Consider Y(i,j) to be noisy if T d >Ti, where Ti,Ti,T3 

and 7^4 are threshold values such that Ti <Ti + i> 
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fori = 1,..., 4. 

B. Estimation of the true value: 

\M , if Y (i, j) noisy 



Y(i,j) = 



X(i,j) , otherwise. 



(3) 



III. Noncausal Linear Prediction 

In the noncausal linear prediction, a noncausal 
neighborhood of pixels is used to make a linear prediction of 
current pixel. The first-order 2D linear predicted value of the 

center pixel Y(i, j) in a 3x3 noncausal neighborhood is 
given by [11]: 

Y(iJ) = a , 1 {Y(i,j-l) + Y(i,j + l)} 
+a 10 {Y(i-l,j) + Y(i + l,j)} (4) 
= Y r a p 

Y = [{Y(i,j-l) + Y(i,j + V)}, 

where T 
Y(i-l,j) + Y(i + l,j)Y 

considering samples at horizontal row and vertical column 

only in the prediction window. Here, a t =[a Ql ,a l0 ] T 

represents the prediction coefficient vector. The first-order 
prediction coefficients are related with the autocorrelation 
functions by the following Wiener-Hopf equation [12]: 



(5) 



The solution of the above matrix equation gives the prediction 
coefficient vector a Using the symmetry 

property R 7] ( i , j ) = R Yj ( - / , - j ) of the 

autocorrelation function of wide-sense stationary image 
random field, it can be shown that [13]: 

a 1 (-i,-j) = a 1 (i,j). (6) 

The symmetry property is used for the computation of the 
prediction coefficients. For first-order 2D noncausal linear 
prediction 



R 



and 



R n (0fi)+R Yl (2,0) 
2^(1,1) 



2R n (l,l) 
R Y{ (0,0)+/? 7l (0,2) 



R Yl (1,0) 

Rn (0,1) 
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For better estimation of the predicted value, the diagonal 
values of the 3x3 noncausal neighborhood are also 
considered. This leads to the second order 2D noncausal 
linear prediction filter which is given by 
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' Y(fj-iy 




J + D 






T 


"fl 2 (0,l) _ 


Y(i-l,j)- 


vY{i 


+ W) 








fl 2 (l,0) 


Y(i-l,j-V)- 


vY{i 


+ 1,;4 


1) 






a 2 (l, 1) 


J(i-l,j + l)- 


vY{i 


+ 1,7" 








a 2 (l,-l) 



Y(i,j) 



and the prediction coefficients are obtained from 



(7) 



(8) 



where 



and 



/?.(qo)+^(Q2) mw+fyXD 
^a-D+/^aD ^(Qq)+^.(2,o) R,m+^ wb+w-i> 

Rfi,Q+m% W 5+^(2,1) ^(QQ+TO ^(Q2)+^Q) 
7?,a-2)+^aq) ^(QD+/?,(2,-l) ^(Q2)+^.(2,C!) 



^(0,1) 
/? y (l,0) 

^(1,1) 
^(1,-1) 



r v = 



For numerical implementation, the autocorrelation functions 
in Equations (5) and (8) are replaced by the estimated 
autocorrelation functions. The estimated autocorrelation 

function, estimated from the pixels in a block of size PxQ 
is given by 



(9) 



R Y a, j) = -^-2 Z Y (.s,t)Y( S + 1 *" '.('+ 1 ')) 

v=i r=i 

IV. Proposed Switching Median Filter 



The block diagram of the proposed filter is shown in Fig. 
1. The filter is based on the concept of substitution of noisy 
pixels prior to estimation. It mainly consists of two stages. In 
the first stage, the noisy pixels are detected by the impulse 



detection stage of the SD-ROM filter. We have used the 
SDROM filter because of its ability to detect an impulse with 
very good accuracy even in the presence of multiple impulses 
within the sliding window. It applies four distinct rank-ordered 
differences to detect an impulse. The rank-ordered differences 
are then compared with four increasing thresholds as 
described in Section II. 

In the second stage, if a pixel is considered to be noisy, it 
is substituted by performing a first-order 2D noncausal linear 
prediction from the neighborhood pixels in the current window 
prior to estimation as described in Section III. Then the noisy 
pixel is replaced by the median value of the pixels within that 
window. This strategy is found to be very effective than the 
conventional method of replacing an impulse by the median 
value in the switching based median filters because here the 
corrupted center pixel is not directly included in the filtering 
window to compute the median value [10]. Instead, it is first 
smoothed by predicting its value from its 2D noncausal 
neighborhood in the image prior to estimation. 

In the present development of the algorithm, we consider 
both the first and second order 2D noncausal linear prediction 
techniques in order to estimate the predicted value from the 
pixels in the noncausal neighborhood. The uncorrupted pixels 
in the image are kept unaltered. 

The proposed algorithm can be summarized as follows: 

Algorithm 1 Proposed Switching Median Filter 

1. Input y 

2. Repeat 

3. Select a 3x3 window W with Y(i, j) being its center. 

4. Apply the impulse detection stage of the SD-ROM filter 
described in Section II for the pixels in 

5. IF is noisy, estimates prediction coefficients using 
Equations (5) and (8) in Section III and substitute the same to 
estimate using Equation (4) and (7), respectively, otherwise 
it is kept unaltered. 

6. Arrange the pixels in with center to an ID array. 

7. Find the median value of. 

8. Finally, replace by the median value of the noncausal 
neighborhood with as the center. 

9. ELSE keep remain unchanged. 

10. Until all is in Y. 

11. Finally, obtain the denoised image. 
Control 
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Fig. 1. Block diagram of the proposed switching median filter 
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V. Experimental Results 

A number of experiments are carried out to evaluate the 
performance of the proposed algorithm with standard 
grayscale test images having distinct features. The test 
images are "Lena" (512x512), "Barbara" 
(512x512),"Boat" (512x512) and "Cameraman" 
( 256 x 256 )• AH tnese images are artificially corrupted with 
the salt and pepper noise at different noise ratios varying 
from 10% to 80%. Noisy pixels are detected by the SD-ROM 
filter. It is implemented by considering a window. The four 
thresholds selected for the SD-ROM filter are from the 
following set of values: = {4, 8, and 12}, = { 15, 20}, = 20, and 
= 30 when the noise density value is below 40% and for 
higher noise densities (i.e. above 40%); we chose the 
thresholds to be similar to that appeared in [5]. 

In the first set of our experiments, we evaluate the 
performance of the impulse noise detection method that we 
have used in this paper. Table I presents PSNR performance 
of the proposed method with two impulse detection methods, 
namely, the detection of extreme values of brightness (i.e. 
and 255) (DEVB) as reported in the NSWM filter, and that of 
the SD-ROM filter, on the "Lena" image corrupted by salt 
and pepper noise at various levels. The results indicate that 
the proposed method with SD-ROM detection performs better 
than the detection method used by the NSWM filter in terms 
of PSNR. On the other hand, Table II shows the number of 
missed detections and the number of false detections against 
noise corruptions at different densities by using the SDROM 
detection. 

In the next set of our experiments, we study the efficacy 
of the noncausal linear prediction methods. To do this, first 
we consider the first-order 2D noncausal linear prediction on 

a 3x3 neighborhood window around the center pixel. 
Considering its position as (0, 0) in the window, the prediction 
coefficients are computed by Equation (5). Finally, the center 
pixel is estimated by Equation (4). Next, we have carried out 
experiments using the second-order 2D noncausal linear 
prediction that utilizes the 8-neighborhood pixels in a 

3x3 window. In this case, the center value is estimated by 
using Equation (7). It may be mentioned here that for low 
noise densities, the second-order noncausal prediction leads 
to slight improvement in the final filtering result over the 
first-order noncausal linear prediction in terms of the peak 
signal-to-noise ratio (PSNR). However, at high noise densities 
(i.e. above 40%), the PSNR improves significantly over that 
obtained with the first-order prediction. The improvement is 
clearly due to the inclusion of the diagonal neighbors along 
with the 4-neighbors in the second-order prediction. Detail 
results are presented in Table-Ill for the "Lena" image 
corrupted by salt and pepper noise at varying densities. The 
only limitation that we observed in the case of second-order 
prediction is due to the increase in the overall computational 
complexity. The time required to run the proposed algorithm 
at high noise densities is significantly higher than the one 



using the first-order prediction. We have also seen that the 
proposed algorithm with second-order prediction fails to give 
better performance than the NSWM method at high noise 
densities. Therefore, in order to evaluate the performance of 
the proposed switching median filter at low to medium noise 
densities and to minimize the overall computational 
complexity, we mainly concentrate on the first-order 2D 
noncausal linear prediction for the rest of our experiments. 

Finally, we have compared the filtering performance of 
the proposed scheme with other switching based median fil- 
ters including the SD-ROM, the ACWM, the DWM, the 
ASWM, and the NSWM filters in terms of the mean-square 
error (MSE) and the peak signal-to-noise ratio (PSNR). Table 
IV shows the comparison of output PSNR and MSE values 
for different filters for the "Lena" image at different percent- 
ages of salt and pepper noise. Similarly, Table V shows the 
corresponding results for the "Boat" image. The results 
clearly indicate that the proposed filter outperforms the state 
of- the-art in terms of PSNR and MSE values for both the test 
images when corrupted by the salt and pepper noise up to 
40%. It is observed that the performance of the proposed 
method deteriorates for noise densities above this value as 
compared to that of the NSWM filter. This is because at 
higher noise densities the probability of getting more than 
one impulse within the 2D neighborhood window becomes 
higher, leading to poor prediction of the center pixel, whereas 
in the NSWM filter, the prediction of the center pixel is done 
from the noise free pixels in a sorted 1 D array. However, the 
results show that the proposed filter outperforms the SD- 
ROM filter, the DWM filter, and the ASWM filter even at 
noise ratios beyond 60%. 

Fig. 2(b)-2(g) show the outputs of various filtering meth- 
ods for the "Lena" image when 40% of the total pixels are 
corrupted by the salt and pepper noise. From a visual inspec- 
tion of the output images, it is observed that the proposed 
filter not only able to remove the noise but also successfully 
preserves the detail features in the image. Similarly, Fig. 4(b)- 
4(g) show the results for the "Barbara" image when corrupted 
by 50% salt and pepper noise. As expected, it is observed 
that the visual quality of the output of the proposed filter 
degrades as the noise ratio is increased to 50% or more. The 
performances of the proposed method and other considered 
filters for "Cameraman" image corrupted by salt and pepper 
noise at different levels in terms of PSNR and MSE are re- 
ported in Fig. 3. The results show that the proposed method 
clearly performs better than other methods up to 40-45% of 
noise in terms of both the parameters. 

Conclusions 

An improved switching based median filter has been pro- 
posed based on the concept of substitution, prior to estima- 
tion for the removal of salt and pepper noise from gray scale 
images. The algorithm consists of two stages. In the first 
stage, the impulses are detected by the impulse detection 
mechanism of the SD-ROM filter. In the second stage, the 
noisy pixel is first predicted using the 2D non causal linear 



©2012 ACEEE 
DOI:01.LTSIR03.01.1 



72 



-cACEEE 



ACEEE Int. J. on Signal & Image Processing, Vol. 03, No. 01, Jan 2012 



prediction technique and subsequently it is replaced by the 
median of its neighborhood pixels. The experimental results 
show that the proposed filter performs better than other 
schemes like the SD-ROM, the ACWM, the DWM, the 
ASWM, and the NSWM filters both visually and quantita- 
tively up to medium level of impulse noise corruption. How- 
ever, at high noise levels NSWM filter outperforms the pro- 
posed filter. The NSWM filter is based on first order causal 
linear prediction only, and does not consider the 2D correla- 
tion of the image pixels. Therefore, it results in blurring of the 
detail features in the image at low to medium noise levels 
as opposed to the proposed filtering scheme. Work is 
currently in progress to extend the proposed method for the 
removal of random valued impulse noise. 

Table I. Performance Comparison Of The Proposed Filter With 
Different ImpulseNoise Detection Methods 



(B) 



Method 




% of Noise 


10 


20 


30 


40 


50 


60 




E __ 


4193 


37.63 


3430 


30. SO 


27.4S 


23.33 


SD-ROM 


42.17 


37.96 


34.73 


31.53 


2S.76 


24.94 



Table II. Performance Analysis Of The Sdrom Detection Method At 
Different Noise Densities 



% of Noise 


Missed DeteclLcn 


FalseDetejlicn 


10 


43 


440 


20 


2.52 


474 


30 


914 


566 


40 


2300 


637 


50 


5SS6 


925 


60 


11723 


:-55 



Table III. Results Of The Proposed Filter With Different Orders Of 
Prediction On "Lena" Image At Different Noise Densities 



Proposed 
Method 
Usiu.E 


c:\otse 


20 


30 


40 


50 


60 


70 


30 


First-order 
Prediction 


37.96 


34.73 


31.53 


2S.76 


2494 


17.5S 


13.93 


Second-order 
Prediction 


37.9S 


34.76 


3194 




2606 


21.S9 


17.16 



Table IV. Performances of various filters on "lena" image at different 

NOISE DENSITIES, (a) PSNR IN DB AND (b) MSE 

(A) 



Method 


% of Noise 


10 


20 


30 


40 


50 


60 


1 — - 

SD-ROM[5] 


32.93 


31.45 


29.32 


27.02 


23.93 


2016 


ACWM[7] 


39.93 


35.57 


31.63 


23.13 


23.99 


20.32 




39.94 


3616 


33.32 


3144 


23.36 


25.45 


AS\VM[9] 


33.27 


32.73 


31.06 


29.21 


25.51 


20.69 


NSWM[10] 


41.52 


37.23 


34.30 


31.24 


30.52 


2S.44 


Proposed 


42.03 


37.95 


3-1.73 


3L53 


23.76 


24.94 
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Method 




% of Noise 


10 


20 


30 


40 


50 


60 


sd-ro: 


m 


32.69 


46.50 


76.04 


131.13 


272.96 


625.75 


AC\YM[7] 


6.59 


13.02 


4413 


99.91 


259.25 


603.69 


D\VM[S] 


6.50 


16.33 


36.04 


54.75 


33.23 


213 31 


ASWMfS] 


30.04 


35.73 


50.36 


77.91 


132.62 


554.12 


NS\VM[10] 


421 


11.17 


20.31 


33.73 


57.64 


92.99 


Proposed 


3,39 


s.?3 


19.32 


37.93 


90.96 


22-1, 90 



Table V. Performances Of Various Filters On "Boat" Image At 
Different Noise Densities. (A) Psnr In Db And (B) Mse 

(A) 



Method 




% of Noise 


10 


20 


30 


40 


50 


60 


SD-R0M[5] 


23.43 


2739 


26.01 


2436 


2157 


19.43 


ACWM[7] 




31.26 


23.65 


25.39 


::.;> 


19.53 


D\YM[S] 


3421 


32.60 


29.70 


26.43 


24 31 


22.39 


AS\VM[9] 


2913 


23.63 


27.60 


26.03 


23.60 


19.30 


NSWM[1G] 


37.96 


34.12 


31.53 


29.33 


27.51 


25.72 


Proposed 


33,96 


35.16 


32.26 


29,53 


26,60 


23.37 



(B) 



Method 


% of Noise 


10 


20 


30 


40 


50 


60 


SD-R0M[5] 


93.14 


113.50 


163 26 


237.94 


412.35 


732.64 


AC\VM[7] 


25.90 


43.63 


33.52 


167.23 


326.14 


715.70 


DWM[S] 


22 04 


39.69 


60.23 


146.13 


21454 


374.61 


ASWM[9] 


79.43 


91.24 


11279 


160.04 


233.30 


679.61 


NSWM[10] 


1013 


25.77 


45.19 


75.72 


::5..^ 


174.03 


Proposed 


3.26 


19.82 


33.65 


71.62 


142,37 


299.99 




30 35 40 
% ot Nate* 

(a) 
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(g) GO 



Fig. 4. Performance of different filters for "Barbara" image with 
50% salt and pepper noise, (a) Noisy, (b) SD-ROM. (c) ACWM. (d) 
ASWM. (e) DWM. (f) NSWM. (g) Proposed and (h) Original. 
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